Gauging credibility of digital content items

ABSTRACT

Provided are techniques for gauging credibility of digital content items. For each digital content item in a list of digital content items, a usage score is identified for each different level of usage and for a user base and the usage score for each different level of usage is added to obtain a total usage score for the digital content item. Each digital content item in the list is ranked using the total score of each digital content item.

FIELD

Embodiments of the invention relate to gauging credibility of digitalcontent items by tracking different levels of usage by a group of userswithin a closed secure environment.

BACKGROUND

Hypertext web search engines track usage patterns of a large base ofpeople (e.g., usage patterns such as keyword searches and the links thatare clicked on) to ascertain the relevance or quality of the results(“hits”) for a search query. This surfaces links that are more popularor trending at a particular point in time, and the popular/trendinglinks surface higher as more users click on them. “Surfaces” may bedescribed as identifying with a search query, prioritizing, increasingin importance, etc.

In closed and secure environments, it is may be more difficult tosurface relevance or quality of documents for questions of similarcontext, especially if documents are continuously streaming in and theuser base is much smaller. This makes it difficult for internal searchengines to surface some documents that are more relevant or important tosearch queries than other documents.

There are citation trackers that are able to track the number of timesdocuments were cited by other publications.

SUMMARY

Provided is a method for gauging credibility of digital content items.The method comprises, for each digital content item in a list of digitalcontent items, identifying, using a processor of a computer, a usagescore for each different level of usage and for a user base and addingthe usage score for each different level of usage to obtain a totalusage score for the digital content item; and ranking each digitalcontent item in the list using the total score of each digital contentitem.

Provided is a computer program product for gauging credibility ofdigital content items. The computer program product comprises a computerreadable storage medium having program code embodied therewith, theprogram code executable by at least one processor to perform:identifying, by the at least one processor, a usage score for eachdifferent level of usage and for a user base and adding, by the at leastone processor, the usage score for each different level of usage toobtain a total usage score for the digital content item; and ranking, bythe at least one processor, each digital content item in the list usingthe total score of each digital content item.

Provided is a computer system for gauging credibility of digital contentitems. The computer system comprises: one or more processors, one ormore computer-readable memories and one or more computer-readable,tangible storage devices; and program instructions, stored on at leastone of the one or more computer-readable, tangible storage devices forexecution by at least one of the one or more processors via at least oneof the one or more memories, to perform: for each digital content itemin a list of digital content items, identifying a usage score for eachdifferent level of usage and for a user base and adding the usage scorefor each different level of usage to obtain a total usage score for thedigital content item; and ranking each digital content item in the listusing the total score of each digital content item.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Referring now to the drawings in which like reference numbers representcorresponding parts throughout:

FIG. 1 illustrates, in a block diagram, a computing environment inaccordance with certain embodiments.

FIG. 2 illustrates, in a flow diagram, operations for gaugingcredibility of digital content items in accordance with certainembodiments.

FIG. 3 illustrates surfacing digital content items in a search query inscreenshot in accordance with certain embodiments.

FIG. 4 illustrates a summary of a digital content item being selectedfor reading in screenshot in accordance with certain embodiments.

FIG. 5 illustrates a digital content item being selected for saving inscreenshot in accordance with certain embodiments.

FIG. 6 illustrates selection of a portion of a digital content item forhighlighting in screenshot in accordance with certain embodiments.

FIG. 7 illustrates citing of a digital content item in a document inscreenshot in accordance with certain embodiments.

FIG. 8 illustrates a cloud computing node in accordance with certainembodiments.

FIG. 9 illustrates a cloud computing environment in accordance withcertain embodiments.

FIG. 10 illustrates abstraction model layers in accordance with certainembodiments.

DETAILED DESCRIPTION

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

FIG. 1 illustrates, in a block diagram, a computing environment inaccordance with certain embodiments. In the computing environment, acomputing device 100 is coupled to a data store 150. The computingdevice 100 includes a search engine 110 and a usage engine 120. Incertain embodiments, the usage engine 120 is separate from the searchengine 110. In certain alternative embodiments, the usage engine 120 ispart of the search engine 110. The data store 150 includes digitalcontent items 160 (which may be any information, such as, but notlimited to, documents, reports, web pages, videos, etc.), usage data170, search results of digital content items ranked based on usage data180, and usage scores 190. In certain embodiments, digital content itemsmay also be referred to as “evidence”.

With embodiments, the usage engine 120 uses different levels of usagepatterns to ascertain the quality of digital content items for specificquery contexts. Each of the different levels may be associated with arange of severity. In certain embodiments, the different levels of usagerank in order of importance from surfacing a digital content item,reading a summarized digital content item (e.g., based on amount of timespent by user after a summary is selected), flagging/saving a digitalcontent item (e.g., based on a user selecting an operation for flaggingor an operation for saving), reading a digital content item entirely(e.g., based on user selecting the digital content item and based on anamount of time spent by the user after the digital content item isselected), marking (e.g., highlighting/commenting on/adding answer to) adigital content item (e.g., based on user selecting an operation forhighlighting, commenting or adding an answer), and citing a digitalcontent item in another digital content item (e.g., a report). Incertain embodiments, the usage engine 120 determines that the digitalcontent item was cited in another digital content item based on thedigital content item being physically saved within a project or case(e.g., in a folder or bucket system). In other embodiments, the usageengine 120 determines that the digital content item was cited in anotherdigital content item by determining that a tool (e.g., a citationtracker) was used to create the citation to the digital content item. Incertain embodiments, the usage engine 120 determines that the digitalcontent item was cited in another digital content item based on a textdocument tool with a plug-in for adding the citation being used to addthe digital content items as a citation. In yet other embodiments, theusage engine 120 mines sections (e.g., bibliographic sections) ofdigital content items to identify citations, and this may be done inembodiments in which related digital content items are placed within asame, closed, secure. These different levels of usage may be used toascertain the quality or relevance of digital content items within anyuser base (e.g., a smaller user base). For example, users may see thedigital content items (e.g., reports) that senior members of a companyor specific experts in a field have read or referenced to gauge qualityor importance of the digital content items.

With embodiments, when a user submits a search query for digital contentitems to the search engine 110, the search engine 110 works inconjunction with the usage engine 120 to rank digital content items thathave higher levels of usage higher in a list of search results.

FIG. 2 illustrates, in a flow diagram, operations for gaugingcredibility of digital content items in accordance with certainembodiments. Control begins at block 200 with the search engine 110receiving a search query for digital content items. In block 202, thesearch engine 110 generates a list of digital content items. In certainembodiments, execution of the search query starts the usage engine 120based on previous queries, pulls the digital content and theirassociated usage scores, and presents the digital content to the user inranked form. In block 204, the usage engine 120, for each of the digitalcontent items in the list, (1) identifies a usage score for eachdifferent level of usage (e.g., surfacing a digital content item,reading a summarized digital content item, flagging/saving a digitalcontent item, reading an digital content item entirely, marking (e.g.,highlighting/commenting on/adding an answer to) a digital content item,and citing a digital content item in another digital content item) andfor a user base and (2) sums the usage score for each different level ofusage to obtain a total usage score for the digital content item. Incertain embodiments, a user may select the differing levels to be used.In certain embodiments, the user may select the differing levels to beused after their queries have been registered. In certain embodiments,the user may select the user base (e.g., only bosses, only experts in afield, everyone on-line, etc. In block 206, the usage engine 120 ranksthe digital content items based on the total usage score for each of thedigital content items. In certain embodiments, a digital content itemwith a higher score is ranked higher than a digital content item with alower score. In certain embodiments, the search engine 110 pulls theranked digital content items and their usage scores from the usageengine 120. In block 208, the search engine 110 displays the digitalcontent items based on the ranking and, optionally, with usage data foreach of the digital content items. In block 210, the usage engine 120monitors a user's interaction with the displayed digital content itemsand updates usage scores for the differing levels of usage for each ofthe displayed digital content items.

With the monitoring of differing levels of usage and assignment ofscores, embodiments enable gauging credibility of digital content items.For example, digital content items with higher scores may be thought ofas more credible/useful/etc.

Thus, in certain embodiments, a digital content item has a usage scorefor each of the differing levels of usage (e.g., if there are 5differing levels of usage, then, the digital content item has 5 usagescores). The usage score for a particular level of usage may be based onthe usage patterns of the user base. In certain embodiments, people whoare renowned in a specific field and use digital content items in thatfield may have multipliers on the usage scores (e.g., to increase theusage score if an expert in a field used the digital content item for aparticular usage level, such as citing the digital content item inanother digital content item).

The usage engine 120 monitors each interaction with the digital contentitem for the differing levels and continues to adjust usage scoresassociated with (e.g., tagged to) the digital content item. Then, when asearch query for a context is done, those differing levels of usage mayserve as an added form of quality or importance of the digital contentitem.

For example, there is a senior researcher who surfaces 10 digitalcontent items, reads the abstract of 5 digital content items, saves 4digital content items, reads 3 digital content items completely,highlights 2 digital content items, and cites 1 digital content item ina final report. All those different levels of usage are tracked andscored so that future related search queries may be able to show theselevels of usage along with search results.

FIGS. 3-7 illustrate example screenshots in accordance with certainembodiments.

FIG. 3 illustrates surfacing digital content items in a search query inscreenshot 300 in accordance with certain embodiments. In FIG. 3, inresponse to a search query 310 being received, a list of search results320 are displayed. In additionally, in FIG. 3, some usage data 350 isdisplayed that shows the consolidation of all the digital content itemswithin the answer to the search query. Each digital content item hasassociated usage scores that may be displayed for the user directly orthat may be provided via, for example, a link that is selected by theuser to obtain the usage scores. In particular, the usage data 350indicates sources for the digital content items, a graph of activitythat shows the recency of the digital content items that are containedwithin this answer so as to gauge whether the digital content items ornewer or older), and some users who have recently reviewed the digitalcontent items.

FIG. 4 illustrates a summary of a digital content item being selectedfor reading in screenshot 400 in accordance with certain embodiments. InFIG. 4, a user has selected a summary of digital content item 410 (“TheSeine as backdrop to Claude Monet paintings”).

FIG. 5 illustrates a digital content item 510 being selected for savingin screenshot 500 in accordance with certain embodiments. Although thisis an example of saving, a user may also select the digital content itemfor flagging (which is shown by the “fold over” (or “dog ear”) in thecorner).

FIG. 6 illustrates selection of a portion of a digital content item forhighlighting in screenshot 600 in accordance with certain embodiments.In FIG. 6, a user is presented with the options to “Comment”,“Highlight” or “Add Answer” 610. In this example, a user has highlighteda portion of the digital content item (Frederic Bazille).

FIG. 7 illustrates citing of a digital content item in a document inscreenshot 700 in accordance with certain embodiments. With FIG. 7, inresponse to user selection of “Save Evidence” 704, “Save with Question &Answer set” 706, and the “Save” button 710, the usage engine 120 savesthe search request (i.e., the question), the search results (i.e., theanswer set), and the digital content items to a particular project orcase, such as “Influential Artists/19^(th) Century/Impressionism” 712.In certain embodiments, when the “Save” button 710 is selected, theusage engine 120 determines that the digital content items are slated tobe used as citations.

Unlike existing citation trackers, embodiments are able to identifyanother digital content item that were read, but not used or anotherdigital content item that had highlighted segments that were eventuallynot used in a final publication. Embodiments use the different levels ofusage to surface greater relevance or quality of digital content itemsto context specific queries.

Embodiments show how a select group of experts have used a digitalcontent item in the past (and other metrics) to help other users gaugethe credibility of a the digital content item that they have found witha search query. Embodiments showing how credible/useful a digitalcontent item is by showing users how that digital content item has beenused in the past.

Embodiments aggregate a context specific set of actions from multipleusers to help another user judge the usefulness of a digital contentitem.

Cloud Embodiments

It is understood in advance that although this disclosure includes adetailed description on cloud computing, implementation of the teachingsrecited herein are not limited to a cloud computing environment. Rather,embodiments of the present invention are capable of being implemented inconjunction with any other type of computing environment now known orlater developed.

Cloud computing is a model of service delivery for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g. networks, network bandwidth, servers, processing,memory, storage, applications, virtual machines, and services) that canbe rapidly provisioned and released with minimal management effort orinteraction with a provider of the service. This cloud model may includeat least five characteristics, at least three service models, and atleast four deployment models.

Characteristics are as follows:

On-demand self-service: a cloud consumer can unilaterally provisioncomputing capabilities, such as server time and network storage, asneeded automatically without requiring human interaction with theservice's provider.

Broad network access: capabilities are available over a network andaccessed through standard mechanisms that promote use by heterogeneousthin or thick client platforms (e.g., mobile phones, laptops, and PDAs).

Resource pooling: the provider's computing resources are pooled to servemultiple consumers using a multi-tenant model, with different physicaland virtual resources dynamically assigned and reassigned according todemand. There is a sense of location independence in that the consumergenerally has no control or knowledge over the exact location of theprovided resources but may be able to specify location at a higher levelof abstraction (e.g., country, state, or datacenter).

Rapid elasticity: capabilities can be rapidly and elasticallyprovisioned, in some cases automatically, to quickly scale out andrapidly released to quickly scale in. To the consumer, the capabilitiesavailable for provisioning often appear to be unlimited and can bepurchased in any quantity at any time.

Measured service: cloud systems automatically control and optimizeresource use by leveraging a metering capability at some level ofabstraction appropriate to the type of service (e.g., storage,processing, bandwidth, and active user accounts). Resource usage can bemonitored, controlled, and reported providing transparency for both theprovider and consumer of the utilized service.

Service Models are as follows:

Software as a Service (SaaS): the capability provided to the consumer isto use the provider's applications running on a cloud infrastructure.The applications are accessible from various client devices through athin client interface such as a web browser (e.g., web-based email). Theconsumer does not manage or control the underlying cloud infrastructureincluding network, servers, operating systems, storage, or evenindividual application capabilities, with the possible exception oflimited user-specific application configuration settings.

Platform as a Service (PaaS): the capability provided to the consumer isto deploy onto the cloud infrastructure consumer-created or acquiredapplications created using programming languages and tools supported bythe provider. The consumer does not manage or control the underlyingcloud infrastructure including networks, servers, operating systems, orstorage, but has control over the deployed applications and possiblyapplication hosting environment configurations.

Infrastructure as a Service (IaaS): the capability provided to theconsumer is to provision processing, storage, networks, and otherfundamental computing resources where the consumer is able to deploy andrun arbitrary software, which can include operating systems andapplications. The consumer does not manage or control the underlyingcloud infrastructure but has control over operating systems, storage,deployed applications, and possibly limited control of select networkingcomponents (e.g., host firewalls).

Deployment Models are as follows:

Private cloud: the cloud infrastructure is operated solely for anorganization. It may be managed by the organization or a third party andmay exist on-premises or off-premises.

Community cloud: the cloud infrastructure is shared by severalorganizations and supports a specific community that has shared concerns(e.g., mission, security requirements, policy, and complianceconsiderations). It may be managed by the organizations or a third partyand may exist on-premises or off-premises.

Public cloud: the cloud infrastructure is made available to the generalpublic or a large industry group and is owned by an organization sellingcloud services.

Hybrid cloud: the cloud infrastructure is a composition of two or moreclouds (private, community, or public) that remain unique entities butare bound together by standardized or proprietary technology thatenables data and application portability (e.g., cloud bursting for loadbalancing between clouds).

A cloud computing environment is service oriented with a focus onstatelessness, low coupling, modularity, and semantic interoperability.At the heart of cloud computing is an infrastructure comprising anetwork of interconnected nodes.

Referring now to FIG. 8, a schematic of an example of a cloud computingnode is shown. Cloud computing node 810 is only one example of asuitable cloud computing node and is not intended to suggest anylimitation as to the scope of use or functionality of embodiments of theinvention described herein. Regardless, cloud computing node 810 iscapable of being implemented and/or performing any of the functionalityset forth hereinabove.

In cloud computing node 810 there is a computer system/server 812, whichis operational with numerous other general purpose or special purposecomputing system environments or configurations. Examples of well-knowncomputing systems, environments, and/or configurations that may besuitable for use with computer system/server 812 include, but are notlimited to, personal computer systems, server computer systems, thinclients, thick clients, handheld or laptop devices, multiprocessorsystems, microprocessor-based systems, set top boxes, programmableconsumer electronics, network PCs, minicomputer systems, mainframecomputer systems, and distributed cloud computing environments thatinclude any of the above systems or devices, and the like.

Computer system/server 812 may be described in the general context ofcomputer system executable instructions, such as program modules, beingexecuted by a computer system. Generally, program modules may includeroutines, programs, objects, components, logic, data structures, and soon that perform particular tasks or implement particular abstract datatypes. Computer system/server 812 may be practiced in distributed cloudcomputing environments where tasks are performed by remote processingdevices that are linked through a communications network. In adistributed cloud computing environment, program modules may be locatedin both local and remote computer system storage media including memorystorage devices.

As shown in FIG. 8, computer system/server 812 in cloud computing node810 is shown in the form of a general-purpose computing device. Thecomponents of computer system/server 812 may include, but are notlimited to, one or more processors or processing units 816, a systemmemory 828, and a bus 818 that couples various system componentsincluding system memory 828 to processor 816.

Bus 818 represents one or more of any of several types of busstructures, including a memory bus or memory controller, a peripheralbus, an accelerated graphics port, and a processor or local bus usingany of a variety of bus architectures. By way of example, and notlimitation, such architectures include Industry Standard Architecture(ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA)bus, Video Electronics Standards Association (VESA) local bus, andPeripheral Component Interconnects (PCI) bus.

Computer system/server 812 typically includes a variety of computersystem readable media. Such media may be any available media that isaccessible by computer system/server 812, and it includes both volatileand non-volatile media, removable and non-removable media.

System memory 828 can include computer system readable media in the formof volatile memory, such as random access memory (RAM) 830 and/or cachememory 832. Computer system/server 812 may further include otherremovable/non-removable, volatile/non-volatile computer system storagemedia. By way of example only, storage system 834 can be provided forreading from and writing to a non-removable, non-volatile magnetic media(not shown and typically called a “hard drive”). Although not shown, amagnetic disk drive for reading from and writing to a removable,non-volatile magnetic disk (e.g., a “floppy disk”), and an optical diskdrive for reading from or writing to a removable, non-volatile opticaldisk such as a CD-ROM, DVD-ROM or other optical media can be provided.In such instances, each can be connected to bus 818 by one or more datamedia interfaces. As will be further depicted and described below,memory 828 may include at least one program product having a set (e.g.,at least one) of program modules that are configured to carry out thefunctions of embodiments of the invention.

Program/utility 840, having a set (at least one) of program modules 842,may be stored in memory 828 by way of example, and not limitation, aswell as an operating system, one or more application programs, otherprogram modules, and program data. Each of the operating system, one ormore application programs, other program modules, and program data orsome combination thereof, may include an implementation of a networkingenvironment. Program modules 842 generally carry out the functionsand/or methodologies of embodiments of the invention as describedherein.

Computer system/server 812 may also communicate with one or moreexternal devices 814 such as a keyboard, a pointing device, a display824, etc.; one or more devices that enable a user to interact withcomputer system/server 812; and/or any devices (e.g., network card,modem, etc.) that enable computer system/server 812 to communicate withone or more other computing devices. Such communication can occur viaInput/Output (I/O) interfaces 822. Still yet, computer system/server 812can communicate with one or more networks such as a local area network(LAN), a general wide area network (WAN), and/or a public network (e.g.,the Internet) via network adapter 820. As depicted, network adapter 820communicates with the other components of computer system/server 812 viabus 818. It should be understood that although not shown, other hardwareand/or software components could be used in conjunction with computersystem/server 812. Examples, include, but are not limited to: microcode,device drivers, redundant processing units, external disk drive arrays,RAID systems, tape drives, and data archival storage systems, etc.

Referring now to FIG. 9, illustrative cloud computing environment 950 isdepicted. As shown, cloud computing environment 950 comprises one ormore cloud computing nodes 810 with which local computing devices usedby cloud consumers, such as, for example, personal digital assistant(PDA) or cellular telephone 954A, desktop computer 954B, laptop computer954C, and/or automobile computer system 954N may communicate. Nodes 810may communicate with one another. They may be grouped (not shown)physically or virtually, in one or more networks, such as Private,Community, Public, or Hybrid clouds as described hereinabove, or acombination thereof. This allows cloud computing environment 950 tooffer infrastructure, platforms and/or software as services for which acloud consumer does not need to maintain resources on a local computingdevice. It is understood that the types of computing devices 954A-Nshown in FIG. 9 are intended to be illustrative only and that computingnodes 810 and cloud computing environment 950 can communicate with anytype of computerized device over any type of network and/or networkaddressable connection (e.g., using a web browser).

Referring now to FIG. 80, a set of functional abstraction layersprovided by cloud computing environment 950 (FIG. 9) is shown. It shouldbe understood in advance that the components, layers, and functionsshown in FIG. 80 are intended to be illustrative only and embodiments ofthe invention are not limited thereto. As depicted, the following layersand corresponding functions are provided:

Hardware and software layer 8060 includes hardware and softwarecomponents.

Examples of hardware components include mainframes, in one example IBM®zSeries® systems; RISC (Reduced Instruction Set Computer) architecturebased servers, in one example IBM pSeries® systems; IBM xSeries®systems; IBM BladeCenter® systems; storage devices; networks andnetworking components. Examples of software components include networkapplication server software, in one example IBM Web Sphere® applicationserver software; and database software, in one example IBM DB2® databasesoftware. (IBM, zSeries, pSeries, xSeries, BladeCenter, WebSphere, andDB2 are trademarks of International Business Machines Corporationregistered in many jurisdictions worldwide).

Virtualization layer 8062 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers;virtual storage; virtual networks, including virtual private networks;virtual applications and operating systems; and virtual clients.

In one example, management layer 8064 may provide the functionsdescribed below. Resource provisioning provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricingprovide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may comprise applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal provides access to the cloud computing environment forconsumers and system administrators. Service level management providescloud computing resource allocation and management such that requiredservice levels are met. Service Level Agreement (SLA) planning andfulfillment provide pre-arrangement for, and procurement of, cloudcomputing resources for which a future requirement is anticipated inaccordance with an SLA.

Workloads layer 8066 provides examples of functionality for which thecloud computing environment may be utilized. Examples of workloads andfunctions which may be provided from this layer include: mapping andnavigation; software development and lifecycle management; virtualclassroom education delivery; data analytics processing; transactionprocessing; and usage processing.

Thus, in certain embodiments, software or a program, implementing usageprocessing in accordance with embodiments described herein, is providedas a service in a cloud environment.

In certain embodiments, the computing device 100 has the architecture ofcomputing node 810. In certain embodiments, the computing device 100 ispart of a cloud environment. In certain alternative embodiments, thecomputing device 100 is not part of a cloud environment.

Additional Embodiment Details

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

1-20. (canceled)
 21. A computer-implemented method, comprisingoperations for: in response to receiving a search query, generating,using a processor of a computer, a list of digital content items; foreach digital content item in the list of digital content items,identifying, using the processor of the computer, a usage score for eachdifferent level of usage of different levels of usage to be used;increasing, using the processor of the computer, the usage score foreach different level of usage based on a multiplier associated with anexpert in a field; and adding, using the processor of the computer, theusage score for each different level of usage to obtain a total usagescore for the digital content item; and providing, using the processorof the computer, a response to the search query by displaying eachdigital content item according to a ranking based on the total usagescore for each digital content item, with a summary for each digitalcontent item, and with usage data, wherein the usage data indicatessources for the digital content items and a source breakdown, indicatesa graph of activity that shows recency of the digital content items, andindicates a subset of users who have recently reviewed at least one ofthe digital content items.
 22. The computer-implemented method of claim21, further comprising operations for: monitoring, using the processorof the computer, interactions with each of the digital content itemsthat are displayed; and in response to the monitoring, updating, usingthe processor of the computer, the usage score for each of the differentlevels of usage for each of the displayed digital content items.
 23. Thecomputer-implemented method of claim 21, further comprising operationsfor: saving, using a processor of the computer, the search query and thelist of digital content items with a project.
 24. Thecomputer-implemented method of claim 21, wherein the different levels ofusage are selected from surfacing a digital content item, reading asummarized digital content item in response to selection of a summary,any of flagging and saving the digital content item, reading the digitalcontent item entirely in response to selection of the digital contentitem, marking the digital content item to provide a comment, and citingthe digital content item in another digital content item.
 25. Thecomputer-implemented method of claim 21, further comprising operationsfor: receiving, using the processor of the computer, selection of a userbase from a plurality of user bases, wherein the usage score is based onthe user base.
 26. The computer-implemented method of claim 21, whereina Software as a Service (SaaS) is configured to perform the operationsof the computer-implemented method.
 27. A computer program product, thecomputer program product comprising a computer readable storage mediumhaving program code embodied therewith, the program code executable byat least one processor to perform operations for: in response toreceiving a search query, generating a list of digital content items;for each digital content item in the list of digital content items,identifying a usage score for each different level of usage of differentlevels of usage to be used; increasing the usage score for eachdifferent level of usage based on a multiplier associated with an expertin a field; and adding the usage score for each different level of usageto obtain a total usage score for the digital content item; andproviding a response to the search query by displaying each digitalcontent item according to a ranking based on the total usage score foreach digital content item, with a summary for each digital content item,and with usage data, wherein the usage data indicates sources for thedigital content items and a source breakdown, indicates a graph ofactivity that shows recency of the digital content items, and indicatesa subset of users who have recently reviewed at least one of the digitalcontent items.
 28. The computer program product of claim 27, wherein theprogram code is executable by the at least one processor to performoperations for: monitoring interactions with each of the digital contentitems that are displayed; and in response to the monitoring, updatingthe usage score for each of the different levels of usage for each ofthe displayed digital content items.
 29. The computer program product ofclaim 27, wherein the program code is executable by the at least oneprocessor to perform operations for: saving the search query and thelist of digital content items with a project.
 30. The computer programproduct of claim 27, wherein the different levels of usage are selectedfrom surfacing a digital content item, reading a summarized digitalcontent item in response to selection of a summary, any of flagging andsaving the digital content item, reading the digital content itementirely in response to selection of the digital content item, markingthe digital content item to provide a comment, and citing the digitalcontent item in another digital content item.
 31. The computer programproduct of claim 27, wherein the program code is executable by the atleast one processor to perform operations for: receiving selection of auser base from a plurality of user bases, wherein the usage score isbased on the user base.
 32. The computer program product of claim 27,wherein a Software as a Service (SaaS) is configured to perform theoperations of the computer program product.
 33. A computer system,comprising: one or more processors, one or more computer-readablememories and one or more computer-readable, tangible storage devices;and program instructions, stored on at least one of the one or morecomputer-readable, tangible storage devices for execution by at leastone of the one or more processors via at least one of the one or morememories, to perform operations comprising: in response to receiving asearch query, generating a list of digital content items; for eachdigital content item in the list of digital content items, identifying ausage score for each different level of usage of different levels ofusage to be used; increasing the usage score for each different level ofusage based on a multiplier associated with an expert in a field; andadding the usage score for each different level of usage to obtain atotal usage score for the digital content item; and providing a responseto the search query by displaying each digital content item according toa ranking based on the total usage score for each digital content item,with a summary for each digital content item, and with usage data,wherein the usage data indicates sources for the digital content itemsand a source breakdown, indicates a graph of activity that shows recencyof the digital content items, and indicates a subset of users who haverecently reviewed at least one of the digital content items.
 34. Thecomputer system of claim 33, wherein the operations further comprise:monitoring interactions with each of the digital content items that aredisplayed; and in response to the monitoring, updating the usage scorefor each of the different levels of usage for each of the displayeddigital content items.
 35. The computer system of claim 33, wherein theoperations further comprise: saving the search query and the list ofdigital content items with a project.
 36. The computer system of claim33, wherein the different levels of usage are selected from surfacing adigital content item, reading a summarized digital content item inresponse to selection of a summary, any of flagging and saving thedigital content item, reading the digital content item entirely inresponse to selection of the digital content item, marking the digitalcontent item to provide a comment, and citing the digital content itemin another digital content item.
 37. The computer system of claim 33,wherein the operations further comprise: receiving selection of a userbase from a plurality of user bases, wherein the usage score is based onthe user base.
 38. The computer system of claim 33, wherein a Softwareas a Service (SaaS) is configured to perform the operations of thecomputer system.